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(54) Video encoding methods and apparatus 

(57) A moving picture encoding method and appa- 
ratus for processing digital signals, and a recording me- 
dium, in which, when it is specified to skip a portion of 
a moving picture program to be reproduced, the pro- 
gram portion lying forwardly of a skipping start point and 
the program portion lying backwardly of a skipping end 
point are to be reproduced seamlessly. An analysis unit 
assumes that a GOP (GOP-new-0) is encoded with a 
pre-set quantity of allocated bits, and calculates a bit 


storage quantity (boe) of a virtual decoder after the end 
of decoding of the last picture of the GOP (GOP-new-0) 
(step S24). The analysis unit then compares the size of 
the bit storage quantity (boe) to the size of the bits (step 
S25). If the size of the bit storage quantity (boe) is found 
to exceed the size of the bits, a picture B0 of the GOP 
(GOP-0) is re-encoded to an I -picture lOx, while an out- 
point picture B1 is re-encoded to a p-picture P1x, in or- 
der to generate a new GOP (GOP-new-0). 
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Description 

[0001] This invention relates to moving picture encod- 
ing methods, apparatus and recording media, such as 
those for processing digital signals encoded by orthog- 
onal transform, such as discrete cosine transform. 
[0002] Recently, the so-called MPEG (Moving Picture 
Experts Group) or MPEG2, which combines the encod- 
ing of picture signals for compression with redundancy 
reducing processing by orthogonal transform such as 
discrete cosine transform (DCT) with motion compen- 
sation MC, has entered widespread use. 
[0003] For doing the predictive coding employing mo- 
tion compensation, the MPEG2 uses a structure of 
group-of-pictures (GOP) comprised of three elements 
termed I-, P- and B-pictures. The l-picture (intra-picture) 
is produced by intra-picture encoding without having re- 
liance to predictive coding from a previous picture. 
[0004] It is noted that, if only pictures produced using 
predictive coding are arrayed, pictures cannot be re- 
trieved instantaneously on random accessing. There- 
fore, accessing references are periodically produced to 
cope with random accessing. That is, the I -pictures 
serve for maintaining the GOP independency. 
[0005] The frequency of appearance of I -pictures is 
determined by the performance of the random access- 
ing required by the application. Usually, one l-picture is 
used in each GOP, such that, if two GOPs appear per 
second, one l-picture is used per 1 5 frame pictures. The 
GOP is a group of pictures from an l-picture to the next 
l-picture. The picture prediction is made among the pic- 
tures making up one such group. 
[0006] P-pictures (predictive-coded pictures), made 
by predictive coding from the directly previous picture, 
are obtained on the basis of an l-picture. In distinction 
from the l-picture (intra-frame coded picture), the P-pic- 
ture is defined as an inter-frame forward predicted pic- 
ture. B-pictures (bi-directionally predictive coded pic- 
tures) are made by prediction from two pictures, namely 
a temporally forward picture and a temporally back- 
wards picture. 

[0007] Scrutinizing further into the relation among the 
I-, P- and B-pictures in a GOP, a first-stage prediction 
from the l-picture lying at the leading end of the GOP is 
made in the forward direction to produce a P-picture. 
This P-picture is arrayed as skipping a B-picture pro- 
duced later. 

[0008] The second stage of prediction is made from 
Jwo pictures, that is the initial l-picture and the P-picture 
encoded at the first stage. That is, one or plural B-pic- 
tures are produced by bi-directional prediction. Further, 
a B-picture is similarly produced between the first and 
second P-pictures. At the time of decoding, motion com- 
pensation for the B-picture is achieved using two refer- 
ence pictures by two motion vectors and two reference 
pictures, that is a forward reference picture and a back- 
ward reference picture. 

[0009] The bi-directional prediction, characteristic of 


MPEG, gives a high prediction efficiency in prediction 
by employing two pictures, that is a temporally past pic- 
ture and a temporally future picture. 
[0010] Meanwhile, there are occasions wherein it is 
s specified to skip part of the moving picture program by 
the MPEG2 in reproduction. Duetothe above-described 
MPEG2 encoding method, the MPEG2 pictures are usu- 
ally reproduced by predictively referring to pictures tem- 
porally ahead and in back of a picture in question. 
[0011] Therefore, it is usually required to make refer- 
ence for prediction to a picture at back of a skipping start 
point and a picture ahead of the skipping end point, so 
that it is difficult to reproduce pictures seamlessly from 
the skipping start point to the skipping end point. 
[0012] If, for example, the in-point picture is a B-pic- 
ture, it is necessary to previously decode the I- or P- 
picture required for decoding this B-picture. In this case, 
there is a risk of interruption of reproduced pictures. 
[001 3] It is therefore an aim of at least an embodiment 
of the present invention to provide a moving picture en- 
coding method and apparatus whereby, if it is specified 
to skip a portion of a moving picture program for repro- 
duction, a GOP ahead of a skipping start point and a 
GOP at back of the skipping end point can be re-encod- 
ed efficiently in order to seamlessly reproduce the pro- 
gram ahead of the skipping start point and a program at 
back of the skipping start point. 

[0014] It is another aim of an embodiment of the 
present invention to provide a recording medium having 
a corresponding control program recorded thereon. 
[0015] In one aspect, the present invention provides 
a moving picture encoding method including a re-con- 
structing step for re-constructing the input video stream 
by re-encoding the pictures of the group of pictures con- 
taining the out-point picture beginning from the initial 
display picture of the group of pictures up to the out- 
point picture into inter-picture predictive-coded pictures 
that can be predicted from pictures of another group of 
pictures displayed directly before the group of pictures 
containing the out-point picture, for re-construction into 
a group of pictures that can be decoded without having 
predictive reference to display pictures lying at back of 
the out-point picture. 

[0016] In another aspect, the present invention pro- 
vides a moving picture encoding device including re- 
constructing means for re-constructing the input video 
stream by re-encoding the pictures of the group of pic- 
tures containing the out-point picture from the initial dis- 
play picture up to the out-point picture into inter-picture 
predictive-coded pictures that can be predicted from pic- 
tures of another group of pictures displayed directly be- 
fore the group of pictures containing the out-point pic- 
ture, for re-constructing the picturers into a group of pic- 
tures that can be decoded without having predictive ref- 
erence to display pictures lying backwardly of the out- 
point picture. 

[0017] In a further aspect, the present invention pro- 
vides a recording medium having recorded thereon a 
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control program for re-constructing the input video 
stream by re-encoding the pictures ofthe group ofpic- 
tures containing the out-point picture from the initial dis- 
play picture of the group of pictures up to the out-point 
picture into inter-picture predictive-coded pictures that s 
can be predicted from pictures of another group of pic- 
tures displayed directly before the group of pictures con- 
taining the out-point picture, for re-constructing the pic- 
tures into a group of pictures that can be decoded with- 
out having predictive reference to display pictures lying 
backwardly of the out -point picture. 
[0018] In a further aspect, the present invention pro- 
vides a moving picture encoding method including a re- 
constructing step of re-constructing the input video 
stream by re-encoding the first intra-coded picture of a 
group of pictures displayed directly backwardly of a 
group of pictures containing the in-point picture to an 
inter-picture predictive-coded picture that is predicted 
from a picture of the group of pictures containing the in- 
point picture, for re-constructing the pictures into a 
group ofpictures that can be decoded without having 
predictive reference to display pictures lying ahead of 
the in-point picture. 

[0019] In a further aspect, the present invention pro- 
vides a moving picture encoding device re-constructing 
means for re-constructing the input video stream by re- 
encoding the first intra-coded picture of a group of pic- 
tures displayed directly backwardly of a group of pic- 
tures containing the in-point picture to an inter-picture 
predictive-coded picture that is predicted from a picture 
of the group of pictures containing the in-point picture, 
for re-constructing the pictures into a group of pictures 
that can be decoded without having predictive reference 
to display pictures lying ahead of the in-point picture. 
[0020] In a further aspect, the present invention pro- 
vides a recording medium having recorded thereon a 
control program for the control program re-constructs 
the input video stream by re-encoding the first intra-pic- 
ture coded picture of a group ofpictures displayed direct- 
ly backwardly of the group of pictures containing the in- 
point picture to an inter-picture predictive-coded picture 
predicted from a picture of the group of pictures contain- 
ing the in-point picture, for re-constructing the pictures 
into a group ofpictures that can be decoded without hav- 
ing predictive reference to display pictures lying ahead 
of the in-point picture. 

[0021] In a further aspect, the present invention pro- 
vides a moving picture encoding method including a re- 
constructing step of re-constructing, in an input bit- 
stream, a group of pictures of a unit domain containing 
the first point up to the first point in a display sequence, 
and a group of pictures of a unit domain directly previous 
to the group of pictures containing the first point in the 
display sequence, into a first group of pictures that can 
be decoded without predictive reference to a picture ly- 
ing backwardly of the first point, and of re-constructing 
pictures beginning from the second point in the display 
sequence of a group of pictures of a unit domain con- 


taining the second point, and another group ofpictures 
pfthe unit domain directly following the group of pictures 
containing the second point in the display sequence, in- 
to a second group of pictures that can be decoded with- 
out predictive reference to pictures lying forwardly of the 
second point. 

[0022] In a further aspect, the present invention pro- 
vides a moving picture encoding device including re- 
constructing means for re-constructing, in an input bit- 
stream, a group of pictures of a unit domain containing 
the first point up to the first point in a display sequence, 
and a group of pictures of a unit domain directly previous 
to the group of pictures containing the first point in the 
display sequence, into a first group of pictures that can 
be decoded without predictive reference to a picture ly- 
ing backwardly of the first point, and for re -constructing 
pictures beginning from the second point in the display 
sequence of a group of pictures of a unit domain con- 
taining the second point, and another group of pictures 
of the unit domain directly following the group ofpictures 
containing the second point in the display sequence, in- 
to a second group of the second point. 
[0023] In a further aspect, the present invention pro- 
vides a recording medium having recorded thereon a 
control program formulated for re-constructing, in an in- 
put bitstream, a group of pictures of a unit domain con- 
taining the first point up to the first point in a display se- 
quence, and a group of pictures of a unit domain directly 
previous to the group of pictures containing the first point 
in the display sequence, into a first group of pictures that 
can be decoded without predictive reference to a picture 
lying backwardly of the first point, and for re-constructing 
pictures beginning from the second point in the display 
sequence of a group of pictures of a unit domain con- 
taining the second point, and another group of pictures 
of the unit domain directly following the group of pictures 
containing the second point in the display sequence, in- 
to a second group of the second point. 
[0024] In a further aspect, the present invention pro- 
vides a moving picture encoding method including a re- 
constructing step of decoding a group of pictures of the 
unit domain containing the first point if the first point is 
the bidirectionally predictive-coded picture to re-encode 
pictures up to the first point in the display sequence, and 
of decoding a group of pictures of the unit domain con- 
taining the second point if the second point is a forwardly 
predictive-coded picture or a bidirectionally predictive- 
coded picture, to re-encode pictures lying backwardly of 
the second point in the display sequence. 
[0025] In a further aspect, the present invention pro- 
vides a moving picture encoding device including re- 
constructing means for decoding a group of pictures of 
the unit domain containing the first point if the first point 
is the bidirectionally predictive-coded picture to re-en- 
code pictures up to the first point in the display se- 
quence, and for decoding a group of pictures of the unit 
domain containing the second point if, the second point 
is a forwardly predictive -coded picture or a bidirection- 
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ally predictive-coded picture to re-encode pictures lying 
backwardly ofthe second point in the display sequence. 
[0026] In yet another aspect, the present invention 
provides a recording medium having recorded thereon 
a control program for decoding a group of pictures of the 
unit domain containing the first point if the first point is 
the bidirectionally predictive-coded picture to re-encode 
pictures up to the first point in the display sequence, and 
for decoding a group of pictures of the unit domain con- 
taining the second point if the second point is a forwardly 
predictive-coded picture or a bidirectionally predictive- 
coded picture, to re-encode pictures lying backwardly of 
the second point in the display sequence. 
[0027] With the moving picture encoding method, 
moving picture encoding device and the recording me- 
dium according to the present invention, an input video 
stream is re-constructed by re-encoding the pictures of 
the group of pictures containing the out-point picture be- 
ginning from the initial display picture of the group of 
pictures up to the out-point picture into inter-picture pre- 
dictive-coded pictures that can be predicted from pic- 
tures of another group of pictures displayed directly be- 
fore the group of pictures containing the out-point pic- 
ture, for re-cohstructing the pictures into a group of pic- 
tures that can be decoded without having predictive ref- 
erence to display pictures lying at back of the out-point 
picture. Thus, the portion of the input bitstream lying for- 
wardly of a skipping start point can be efficiently encod- 
ed to enable seamless reproduction ofthe program por- 
tion lying forwardly ofthe skipping start point and the pro- 
gram portion lying backwardly of the skipping end point. 
[0028] With the moving picture encoding method, 
moving picture encoding device and the recording me- 
dium according to the present invention, an input video 
stream isreconstructed by re-encoding the first intra- 
coded picture of a group of pictures displayed directly 
backwardly of a group of pictures containing the in-point 
picture to an inter-picture predictive-coded picture that 
is predicted from a picture of the group ofpictures con- 
taining the in-point picture, for re-constructing the pic- 
tures into a group ofpictures that can be decoded with- 
out having predictive reference to display pictures lying 
ahead of the in-point picture. Thus, the portion of the 
input bitstream lying forwardly of a skipping start point 
can be efficiently encoded to enable seamless repro- 
duction ofthe program portion lying forwardly ofthe skip- 
ping start point and the program portion lying backward- 
ly of the skipping end point. Also, two groups of pictures 
can be grouped together and an I -picture, for example, 
of the backward side group of pictures can be changed 
to a P-picture to diminish the quantity of the encoding 
bits. 

[0029] With the moving picture encoding method, 
moving picture encoding device and the recording me- 
dium according to the present invention, a group ofpic- 
tures of a unit domain containing the first point up to the 
first point in a display sequence, and a group of pictures 
of a unit domain directly previous to the group of pictures 


containing the first point in the display sequence, is re- 
constructed into a first group of pictures that can be de- 
coded without predictive reference to a picture lying 
backwardly of the first point, and a group of pictures be- 
5 ginning from the second point in the display sequence 
of a group of pictures of a unit domain containing the 
second point, and another group of pictures of the unit 
domain directly following the group of pictures contain- 
ing the second point in the display sequence, are re- 
10 constructed into a second group of pictures that can be 
decoded without predictive reference to pictures lying 
forwardly of the second point. Therefore, if it is specified 
to skip a portion of. the moving picture program in repro- 
ducing it, the program portion lying ahead of the skipping 
is start point and the program portion lying backwardly of 
the skipping end point can be reproduced seamlessly to 
enable efficient encoding of the program portions lying 
forwardly ofthe skipping start point and backwardly ofthe 
skipping end point. Also, two groups of pictures can be 
20 grouped together and an I -picture, for example, of the 
backward side group of pictures can be changed to a P- 
picture to diminish the quantity of the encoding bits. 
[0030] With the moving picture encoding method, 
moving picture encoding device and the recording me- 
25 dium according to the present invention, a group of pic- 
tures of the unit domain containing the first point is de- 
coded if the first point is the bidirectionally predictive- 
coded picture to re-encode pictures up to the first point 
in the display sequence, and a group of pictures of the 
30 unit domain containing the second point is decoded if 
the second point is a forwardly predictive-coded picture 
or a bidirectionally predictive-coded picture, to re-en- 
code pictures lying backwardly of the second point in 
the display sequence. Therefore, if it is specified to skip 
35 a portion of the moving picture program in reproducing 
it, the program portion lying ahead of the skipping start 
point and the program portion lying backwardly of the 
skipping end point can be reproduced seamlessly to en- 
able efficient encoding of the program portions lying for- 
40 wardly of the skipping start point and backwardly ofthe 
skipping end point. 

[0031] The invention will now be described by way of 
example with reference to the accompanying drawings, 
throughout which like parts are referred to by like refer- 
45 ences. and in which: 

[0032] Fig. 1 illustrates re-encoding of a bitstream. 
[0033] Fig. 2 is a time chart showing a bit storage 
quantity of a VBV buffer. 

[0034] Fig. 3 shows the method of moderating the con- 
so straint of the encoding conditions. 

[0035] Fig. 4 shows a system (multiplexed) stream. 
[0036] Fig. 5 is a flowchart showing a series of process 
steps of a moving picture encoding method. 
[0037] Fig. 6 schematically shows the structure of the 
55 entire moving picture encoding device according to an 
embodiment of the invention. 

[0038] Fig. 7 shows an example of re-encoding of 
GOPs ahead and at back of an editing point. 
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[0039] Fig. 8 is a block diagram showing the structure 
of a moving picture recording/reproducing apparatus 
embodying the second aspect of the present invention. 
[0040] Fig. 9 is a flowchart for illustrating the sequence 
of re-encoding and re-multiplexing out- and in-points in 
the moving picture recording/reproducing apparatus 
shown in Fig. 8. 

[0041] Fig. 10 is a flowchart for illustrating the video 
re-encoding sequence on the out-point side. 
[0042] Fig. 11 A illustrates the array of encoded bit- 
stream and Figs. 1 1 B to D illustrate the arrays of the en- 
coded bitstreams on editing out-points by re-encoding. 
[0043] Fig. 12 shows the bit storage volume of an im- 
aginary buffer on editing by re-encoding. 
[0044] Fig. 13 shows a bit storage volume of a buffer 
of an imaginary buffer when assumed that re-encoding 
is done with the picture B11 of a GOP-0 as 11 Ox. 
[0045] Fig. 14 shows a bit storage quantity of an im- 
aginary buffer on encoding by re-encoding. 
[0046] Fig. 15 is a flowchart for illustrating the se- 
quence of re-encoding the in-point in the moving picture 
recording/reproducing apparatus. 
[0047] Fig. 16A illustrates the array of encoded bit- 
stream and Figs. 16B to D illustrate the arrays of the 
encoded bitstreams on re-encoding in-points. 
[0048] Fig. 1 7 shows the bit storage quantity of the im- 
aginary buffer on re-encoding in-points. 
[0049] Fig. 18 shows a bit storage volume of a buffer 
of an imaginary buffer when assumed that re-encoding 
is done with the picture Im2 of a GOP-m as Im2x. 
[0050] Fig. 19 shows the bit storage quantity of the 
imaginary buffer on re-encoding in-points. 
[0051] Referring to the drawings, the moving picture 
encoding method and apparatus and a recording medi- 
um according to the present invention will be explained 
in detail. 

[0052] A first embodiment of the present invention is 
first explained. 

[0053] As shown by an array of an encoded bitstream 
in Fig. 1 A, the processing of a bitstream according to the 
present invention is done such that, on designating the 
reproduction under skipping part of a moving picture 
program, a program lying forwardly of an out-point as a 
first point as the skipping start point in the display se- 
quence corresponding to the time axis direction and a 
program lying at back of an in-point as a second point 
which is the skipping end point can be reproduced 
seamlessly. 

[0054] tn the present moving picture encoding meth- 
od, a moving picture program is given as an encoded 
bitstream of the MPEG2 standard. 
[0055] The encoded bitstream of the MPEG2 stand- 
ard is based on a group-of-pictures (GOP), which is a 
group of pictures of a number of encoded pictures in a 
preset sequence, as a unit. That is, at A in Fig. 1, an 
out-point picture B04 is contained in a GOP-0, which is 
an out-point side GOP contiguous to GOP-(-1). To this 
in-point side GOP is contiguous a GOP-(n+1 ). It is noted 


. that GOP-i means an ith GOP along the time axis cor- 
responding to the picture display sequence. 
[0056] Each GOP is made up of an intra-picture (I- 
picture), which is a reference picture obtained on encod- 

s ing a picture without predictive coding from other pic- 
tures, a predictive coded picture (P-picture), which is a 
forward predictive-coded picture in which the pictures 
are encoded using predictive coding in the forward di- 
rection in the display sequence, and a bi-directionally 

w coded picture (B-picture), which is a picture encoded us- 
ing forward predictive coding and backward predictive 
coding. 

[0057] Each GOP is made up of an I -picture, followed 
by plural P- and B-pictures, in a pre-set order, in the pic- 

is ture display sequence. 

[0058] In encoded bitstreams, shown at A in Fig. 1 , a 
GOP GOP-0, which is an out-point side GOP, is made 
up of pictures arrayed in the order of I02, BOO, B01, P05, 
B03, B04, P08, B06 and B07, while a GOP GOP-n, 

20 which is an in-point side GOP, is made up of pictures 
arrayed in the order of In2, BnO, Bn1, Pn5, Bn3, Bn4, 
Pn8, Bn6 and Bn7. 

[0059] It is noted that lij denotes an l-picture of an ith 
GOP having a display order equal to j, while Pij and Bij 
25 denote a P-picture and a B-picture of a jth GOP, respec- 
tively, having a display order equal to i and a display 
order equal to j, respectively. 

[0060] In the encoded bitstream, shown at A in Fig. 1 , 
it is assumed to be required to reproduce pictures lying 

30 forwardly of an out-point and lying backwardly of an in- 
point in the display sequence seamlessly. 
[0061] To this end, the GOP GOP-0, which is the out- 
point side GOP containing B04 as an out-point picture 
Pout, is decoded. Then, this GOP GOP-0 is re-encoded 

35 so that B04, which is the out-point picture Pout, can be 
decoded without having to make reference for prediction 
to an encoded picture lying backwardly in the display 
sequence. That is, in the array of the encoded bit- 
streams following the re-encoding shown in Fig.lB, the 

40 GOP GOP-0, which is an out-point side GOP shown in 
Fig. 1 A, corresponds to a re-encoded GOP-new-0. 
[0062] On the other hand, the GOP GOP-n, which is 
the in-point side GOP containing Pn5 as an in-point pic- 
ture Pout, is decoded. Then, this GOP GOP-n is re-en- 

45 coded so that Pn5, which is the in-point picture Pin, can 
be decoded without having to make reference for pre- 
diction to an encoded picture lying forwardly in the dis- 
play sequence. That is, in the array of the encoded bit- 
streams following the re-encoding shown in Fig. IB, the 

50 GOP GOP-n, which is an out-point side GOP shown in 
Fig.1 A, corresponds to a re-encoded GOP-new-n. 
[0063] As a result of this re-encoding of the in-point 
side GOP and the out-point side GOP, frames lying for- 
wardly of the in-point and those lying backwardly of the 

55 out-point are seamlessly reproduced, as ind icated by an 
array of reproduced frames F00, F01, F02, F03, F04, 
Fn5, Fn6, Fn7, Fn8, shown in Fig.lC. 
[0064] It is noted that GOP-new-i means a new GOP 
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produced by re-encoding certain pictures of the GOP 
GOP-i. 

[0065] The GOP GOP-new-0 in this instance is a new 
GOP produced from frames F00, F01 , F02, F03, F04, 
obtained by decoding pictures BOO, B01 , B02, B03, B04 
of GOP-0. The GOP GOP-new-n is a new GOP pro- 
duced from frames Fn5, Fn6, Fn7, Fn8 obtained by de- 
coding pictures Pn5, Bn6, Bn7, Pn8 of GOP-n. The 
frame Fij correspond to a picture having corresponding 
suffixes. 

[0066] The above-described sequence of operations 
concerning a bitstream of the MPEG system constitutes 
a re-construction process. 

[0067] The re-encoding of the out-point side GOP is 
specifically explained. 

[0068] If, for example, the out-point picture is an I- or 
P-picture, the out-point side GOP need not necessarily 
be decoded to be then re-encoded, it being sufficient to 
remove pictures downstream of the P- or I -picture next 
to the out-point picture. 

[0069] If, in the array of the encoded bitstream shown 
in Fig.1 A, the picture P05 of the GOP GOP-0, as an out- 
point side GOP, is an out-point picture, pictures down- 
stream of the picture P08 can be removed to create a 
GOP GOP-new-0 as shown below: GPO-0 : 102 BOO 
B0I P05 B03 B04 P08 B06 B07 GO-new-0 : 102 BOO 
B01 P05 B03 B04 

[0070] Ifthe out-point picture is a B-picture, it is nec- 
essary to decode and subsequently encode the out- 
point side GOP. That is, the GOP is re-encoded so that 
the out-point picture can be decoded without predictive 
reference to a picture lying backwardly of the out -point 
picture in the display sequence. 

[0071] If, for example, B04 of the GOP GOP-0, as an 
out-point side GOP, is an out-point picture Pout, as 
shown in Fig. 1 A, re-encoding is made such that pictures 
B03, B04, predictively encoded from the pictures I02, 
P05, can be produced without reference for prediction. 
[0072] First, I02, BOO, B01 , P05, B03 and B04 are de- 
coded to frames F00, F01 , F02, F04, F05, after which 
the frames F00, F01 , F02, F03, F04 are re-encoded, as 
shown below: 

GOP-0: I02 BOO B01 P05 B03 B04 P0S B06 B07 
decoded pictures of GOP-0: F00 F01 F02 F03 F04 F05. 
[0073] Then, in a GOP GOP-new-O(a), F03 and F04 
are re-encoded into P-pictures P03 and P04, which are 
obtained on predictive coding from I02 and P03, respec- 
tively, whereas, in a GOP GOP-new-O(b), F04 is re-en- 
coded into a P-picture P04, while F03 is re-encoded into 
a B-picture B03 which is predictively coded from I02 and 
P04, as shown below: 
GOP-new-O(a): I02 BOO B01 P03 P04, or 
GOP-new-O(b): I02 BOO B01 B04 B03, 
[0074] it being noted that I02, BOO and B02 in the GOP 
GOP-new-O(a) and in the GOP GOP-new-O(b) are pref- 
erably copied from the GOP GOP-0 without using the 
encoding. 

[0075] It should noted that the suffix letters I, B and P 


correspond to pictures having the same suffixes. 
[0076] The re-encoding of the in-point side GOP is 
specifically explained. 

[0077] Ifthe in-point picture is an I -picture, the in-point 
5 side GOP need not necessarily be decoded to be then 
re -encoded. 

[0078] In this case, it suffices if the pictures down- 
stream of the in-point picture are directly copied and 
used in this form. 
10 [0079] If, for example, the picture In2 of the GOP 
GOP-n, as an in-point side GOP, shown in Fig.1 A, the 
pictures downstream of the picture In2 can directly serve 
as a GOP GOP-new-n. 

[0080] If the in-point picture is a P- or B-picture, it is 

15 necessary to re-encode the in-point side GOP. The GOP 
is re-encoded so that the in-point picture can be decod- 
ed without having predictive reference to a picture lying 
forwardly of the in-point picture in the display sequence. 
[0081] If, for example, Pn5 is an in-point picture Pin, 

20 as in the GOP GOP-n in Fig. 1 A, re-encoding is done so 
that Pn5 predictively encoded from In2 can be obtained 
without reference for prediction to In2. First, the pictures 
In2, BnO, Bn1, Pn5, Bn3, Bn4, Pn8, Bn6and Bn7of the 
GOP GOP-n are decoded to frames FnO, Fn1 , Fn2, Fn3, 

25 Fn4, Fn5, Fn6, Fn7, Fn8 and subsequently the frames 
Fn5, Fn6, Fn7, Fn8 are re-encoded. 
[0082] The suffixes I, B and P in the GOP GOP-new- 
n correspond to the pictures F having the same suffixes. 
In the GOP GOP-new-n, Fn5 is re-encoded to an l-pic- 

30 ture tn5, as shown below: 

GOP-n: I02, BnO, Bn1, Pn5, Bn3, Bn4, Pn8, Bn6, Bn7 
decoded pictures of GOP-n: FnO, Fn1, Fn2, Fn3, Fn4, 
Fn5, Fn6, Fn7, Fn8 GOP-new-0: In5, Pn8, Bn6, Bn7 
[0083] If, in another example, Bn3 of the GOP GOP- 

35 n is an in-point picture, it is recommendable to re-en- 
code Fn5 to an I -picture In5 as follows: 
GOP-n: I02, BnO, Bnl, Pn5, Bn3 , Bn4, Pn8, Bn6, Bn7 
decoded pictures of GOP-n: FnO, Fn1, Fn2, Fn3, Fn4, 
Fn5, Fn6, Fn7, Fn8 GOP-new-n: In5, Bn3, Bn4, Pn8, 

40 Bn6, Bn7. 

[0084] That is, in the GOP GOP-n, the first P-picture 
downstream of the in-point picture Bn3 in the display se- 
quence is re-encoded into an l-picture In5. 
[0085] If, in the GOP GOP-(n+1), next following the 

45 re-encoded GOP GOP-new-n, closed_gop =0, the lead- 
ing end B-picture of the GOP GOP-(n+1) refers to the 
original GOP-n picture for prediction. 
[0086] It is noted that closed_gop is a 1 -bit flag in the 
MPEG GOP header and specifies the type ofprediction 

so used in a B-picture directly following the first l-picture 
lying next to the GOP header. 

[0087] The closed_gop set to 1 indicates that the B- 
picture directly following the first l-picture consecutive 
to the GOP header has been encoded using only the 
55 backward prediction or intra-coding. 

[0088] For example, if, in the following picture string: 

laO Pa3 Ba1 Ba2l 1x2 BxO Bx1 Px5 Bx3 Bx4 
where I stands for a GOP boundary. Ifthe closed_gop 
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ofthe GOP beginning from 1x2 is set to "1", it indicates 
that BxO and Bx1 are encoded using only the backward 
prediction from 1x2 or intra-coding, without using the for- 
ward prediction from Pa3 nor bidirectional prediction 
from Pa3 and 1x2. 

[0089] If the closed_gop is set to 0, the GOP in ques- 
tion refers to the picture of the directly previous GOP. 
[0090] The GOP GOP-new-n, obtained on re-encod- 
ing the GOP GOP-n, differs in picture quality from the 
original GOP GOP-n, so that, strictly speaking, there is 
produced a possibility of the mismatching in the picture 
quality of the leading B-picture of the GOP GOP-(n+1). 
It may, however, be presumed that this scarcely affects 
the picture quality of the leading B-picture of the GOP 
GOP-(n+1). If this effect is to be retained to be grave, it 
is of course possible to re-encode the leading B-picture 
of the GOP GOP-(n+1 ) used for predictive coding of the 
original GOP-picture. 

[0091] The constraint imposed on the re-encoding 
condition is now explained. 

[0092] If the GOP GOP-0 as an out-point side GOP 
and the GOP GOP-n as an in-point side GOP are re- 
spectively encoded into a GOP GOP-new-0 and a GOP 
GOP-new-n, it is necessary to take caution so that, on 
reproducing the GOP GOP-n to the GOP GOP-(n+1), 
there is produced no failure ofthe VBV buffer as an im- 
aginary buffer of the decoder defined in MPEG. It is not- 
ed that failure of the VBV buffer means its overflowing 
or underflowing. 

[0093] It is noted that if the application reproducing 
the re-encoded bitstream is able to control the input rate 
to the VBV buffer to prevent buffer overflow, it is only 
sufficient not to cause the buffer underflow. In the fol- 
lowing example, the re-encoding condition under which 
there is caused no buffer underflowing is explained. 
[0094] In this case, the maximum constraint is on the 
encoding bit quantity for the first l-picture of the GOP 
GOP-new-n. That is, in the bit storage quantity of the 
VBV buffer of Fig.2, with the buffer size of 1 .75 Mbits, 
the encoding bit quantity for the first l-picture of the GOP 
GOP-new-n, which is the re-encoded version of the 
GOP GOP-n, as an in-point side GOP containing an in- 
point picture, needs to be not larger than D in Fig.2. 
[0095] The larger the input bitrate of the VBV buffer, 
the smaller is the constraint when re-encoding the GOP 
GOP-new-n. In general, the maximum bitrate as deter- 
mined by the application is the input bitrate of the VBV 
buffer. 

[0096] Meanwhile, in the so-called DVD-Video, or 
MPEG2 MP@ML (main profile/main level) conforming 
toe the digital satellite broadcast, the maximum value of 
the input bitrate of the VBV buffer is 1 5 Mbps. If 1 5 Mbps 
can be obtained in case of digital outputting of the bit- 
stream on a digital bus of the I EEE 1 394 standard by is- 
ochronous transfer, the input bitrate ofthe VBV buffer at 
the time of re-encoding can be set to 1 5 bps. In actuality, 
it is necessary to use such a bitrate corresponding to 
this input bitrate plus the audio or multiplexing overhead 
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. bitrate. 

[0097] The minimum value of the bit quantity of the 
first l-picture of the GOP GOP-new-n, that is the worst 
pattern, is (input bitrate ofthe VBV buffer/frame rate). In 
s such case, it is difficult to encode the GOP GOP-new-n 
to high picture quality. The condition close to this worst 
pattern is likely to occur if the tout-point picture is an I- 
picture or if the number of pictures of the GOP GOP- 
new-0 is as small as two to three. 
io [0098] The method for moderating the re-encoding 
constraint as described above is explained. 
[0099] If pictures shown shaded in Fig.3A, that is if 
two GOPs before the editing out-point GOP-(-1) and 
GOP-0 and two GOPs after the in-point, that is GOP-n 
is and GOP-(n+1), are re-encoded to give a GOP GOP- 
new-A and a GOP GOP-new-B, as shown in Fig.3B, the 
encoding constraint on pictures downstream of the in- 
point picture is moderated to some extent. 
[0100] For encoding to high picture quality, an l-pic- 
20 ture is in need of an encoding bit quantity significantly 
larger than that for P- or B-pictures. However, if an in- 
terval between neighboring l-pictures is as small as two 
to three, it is necessary to reduce the encoding bit quan- 
tity for the l-picture from the bit quantity required for re- 
25 alizing high picture quality, in order to prevent underflow- 
ing of the VBV buffer. In such case, it is difficult to encode 
the GOP to high picture quality. 

[0101] If, in the out-point side program, shown in Fig. 
1 , the out-point picture is an l-picture, or the number of 
30 pictures of the GOP GOP-new-0 is as small as two to 
three, or if, in the in-point side program, the number of 
pictures of the GOP GOP-new-n is as small as two to 
three, the risk is high that the condition close to the 
above-mentioned worst pattern is likely to be produced. 
35 it is difficult in this case to encode the GOPs GOP-new- 
0 or GOP-new-n to high picture quality. 
[0102] In such case, the picture quality can be im- 
proved byre-encoding pictures shown shaded in Fig. 3, 
that is two GOPs before the editing out-point picture, to 
40 a sole GOP GOP-new-A, as for the out-point side pro- 
gram, and by re-encoding the pictures shown shaded in 
Fig. 3, that is two GOPs before the editing out-point pic- 
ture, to a sole GOP GOP-new-A, as for the in-point side 
program. 

45 [0103] An instance of improving the picture quality is 
shown for the out-point side program. 
[01 04] It is initially assumed that the GOPs GOP-(-1 ) 
and GOP-0 are constructed as follows: 

12 B0 B1 P5 B3 B4 P8 B6 B7 Pb B9 Ba 1 12 BO B1 
so P5 B3 B4 P8 B6 B7 Pb B9 Ba 

where I stands for the GOP boundary, such that 
the GOP GOP-(-1) and the GOP GOP-0 are on the left 
and right sides of the symbol T. 

[0105] If, with 12 of the GOP GOP-0 as an out-point 
55 picture, the GOP GOP-0 is re-encoded, the GOP GOP- 
new-0 can be constructed as follows: 

12 BO B1 P5 B3 B4 P8 B6 B7 Pb B9 Ba 1 12 BO B1 
where the GOP GOP-new-0 lies on the right side 
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of the symbol T. 

[0106] If, for improving the picture quality, the two 
GOPs lying on the out-point side, that is GOP-(-1) and 
GOP-new-0, are re-encoded to GOP-new-A, 

12 BO B1 P5 B3 B4 P8 B6 B7 Pb B9 Ba P2 BO B1 
is obtained in which the first (-picture 1 2 of the GOP 
GOP-0 containing the out -point picture (GOP-new-0) is 
re-encoded to a P-picture P2 which can be predicted 
from the picture of the GOP GOP-(-t) directly previous 
o the GOP-0. 

[0107] An instance of picture quality improvement by 
re-encoding the in-point side program is hereinafter ex- 
plained. 

[0108] it is first assumed that the GOPs GOP-n and 
GOP-(n+1) are constructed as follows: 

12 B0 B1 P5 B3 B4 P8 B6 B7 Pb B9 Ba I 12 B0 B1 
P5 B3 B4 P8 B6 B7 Pb B9 Ba 

where the GOP GOP-n and the GOP GOP-(n+1) 
are on the left and right sides of the symbol T. 
[0109] If, with B9 of the GOP GOP-n as an in-point 
picture, the GOP GOP-n is re-encoded, the GOP GOP- 
new-n is constructed as follows: 

lb B9 Ba I 12 B0 B1 P5 B3 B4 P8 B6 B7 Pb B9 Ba 
where the GOP GOP-new-n lies on the left side of the 
symbol T. 

[0110] If, for improving the picture quality, the two 
GOPs lying on the in-point side, that is GOP-n and GOP- 
(n+1), are re-encoded to GOP-new-B, 

lb B9 Ba P2 B0 B1 P5 B3 B4 P8 B6 B7 Pb B9 Ba 
is obtained, in which the first I -picture 12 of the GOP- 
(n+1) indicated directly backwardty of the GOP-n con- 
taining the in-point picture B9 (GOP-new-n) is re-encod- 
ed to the picture P2 predicted from the picture GOP-n 
(GOP-new-n). 

[0111] If limitations are imposed on the number of pic- 
tures of the GOP by the application, there are occasions 
wherein the lengths ofthe GOP-new-A and GOP-new-B 
exceed the limitations. In such case, it suffices if the 
GOPs, that is the GOP-new-A and GOP-new-B, are en- 
coded in respective two GOPs. 
[0112] For example, the out-point side program is 

12 B0 B1 P5 B3 B4 P8 B6 B7 Pb B9 Ba I 12 B0 B1 
before improvement, and is 

12 B0 B1 P5 B3 B4 P8 B6 B7 I lb B9 Ba P2 B0 B1 
after improvement. That is, the two GOPs, namely the 
GOPs GOP-(-1 ) and GOP-new-0, are re-encoded in two 
GOPs, that is the GOP-new-AI and the GOP-new-A2. 
[0113] Also, the in-point side program is 

12 B0 B1 I 12 B0 B1 P5 B3 B4 P8 B6 B7 Pb B9 Ba 
before improvement, and is 

12 B0 B1 I 15 B3 B4 P8 B6 B7 Pb B9 B after im- 
provement. That is, the two GOPs, namely the GOPs 
GOP-(-1) and GOP-new-0, are re-encoded in two 
GOPs, that is the GOP-new-B1 and the GOP-newB2. 
[0114] In these examples, the maximum number of 
the pictures of the GOP is limited to 1 2 by an application. 
[0115] The system (multiplexed) stream is explained. 
[01 16] In the MPEG system, data for multiplexing are 


split into streams of suitable lengths, termed packets, 
and the ancillary information, such as headers, are ap- 
pended thereto. Th e resulting packets are time-division- 
ally multiplexed and transferred in a switching fashion. 
5 [°117] In the MPEG synchronization system, the in- 
formation termed time stamps, specifying when to de- 
code and reproduce data, is attached to the data every 
decoding reproducing unit termed an accessing unit. To 
the time stamps, time reference is afforded by the infor- 
mation termed the system clock reference (SCR). 
[0118] The time stamps may be classed into the re- 
cording output time management information, termed 
the presentation time stamp (PTS), and the decoding 
management information termed decoding time stamp 
(DTS). 

[0119] In the domain for re-encoding, system encod- 
ing is also renewed, so that time stamps are newly at- 
tached. However, in this state, there are produced dis- 
continuities in the time stamps (SCR, PTS and DTS) on 
a system stream ahead and in back of the editing point. 
[01 20] For assuring continuity in the time stamps, it is 
necessary to re-multiplex the entire program to re-attach 
time stamps. However, re-multiplexing time is pro- 
longed, depending on the programming time. Therefore, 
this method is not practical in an application, such as 
editing on a storage medium. 

[0121] Therefore, the re-multiplexing domain is limit- 
ed to the re-encoded domain and a time stamp is at- 
tached only to the new_stc domain. It is noted that the 
domains std and stc2 are the same as the time stamps 
inherently attached to the multiplexed stream. For the 
new-stc domain, system encoding is performed using 
the system time clock (STC) continuous to std . 
[0122] When decoding this system stream, the follow- 
ing measures are used on the system decoder side to 
assure seamless reproduction. 

[0123] The system decoder is advised in advance of 
the point of occurrence of STC discontinuities 
stc1_PTS_end. It should be noted that stc1_PTS_end, 
as a point of STC discontinuity, is the sum of PTS of the 
last displayed picture of the GOP GOP-new-n on stc and 
the picture display time. 

[01 24] After the decoding of GOP-new-n has come to 
a close, the video decoder calculates the following STC 
offset to decode the picture of the GOP-(n+1) when the 
DTS of the picture less the STC offset is equal to the 
STC value. 

[0125] The STC offset and the decoding time of the 
picture of the GOP GOP-(n+1) is given as follows: 

STC offset = (PTS of an initially displayed picture 
of a GOP GOP- (n+1))-stc1_PTS_end 

decoding time of a picture of a GOP GOP-(n+1 ) = 
DTS of a picture of a GOP GOP-(n+1 ) - STC offset 
[0126] When the value of stc1_PTS_end is equal to 
the STC value, switching is made to the PTS of an ini- 
tially displayed picture of the GOP GOP-(n+1 ). As from 
this time on, picture decoding occurs when the STC and 
the DTS of the picture are equal to each other. 
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[0127] The process of the moving picture encoding 
methos is shown in a flowchart of Fig. 5. 
[0128] The step S1 is a re-constructing process of re- 
constructing a portion of an input bitstream of the 
MPEG2 standard up to an out-point in the display se- s 
quence of a GOP containing the out-point into a first 
GOP that can be decoded without reference for predic- 
tion to pictures downstream of the out-point, and re-con- 
structing another portion ofthe input bitstream up to an 
in-point in the display sequence of another GOP con- 
taining the in-point into a second GOP that can be de- 
coded without reference for prediction to pictures up- 
stream of the out-point. Then , processing transfers to 
step S2. 

[0129] At step S2, the input bitstream is delayed at 
least for a time duration necessary for re-construction 
in step S1. At the next step S3, switching is made be- 
tween a bitstream from step S1 and a bitstream from 
step S2 on the GOP basts to output the selected bit- 
stream. This terminates a sequence of operations. 
[0130] A moving picture encoding device is hereinaf- 
ter explained. 

[0131] Referring to Fig. 6, a moving picture encoding 
device includes a pickup 12 for reading out data record- 
ed on an optical disc 101 as a recording medium, a de- 
modulating circuit 1 3 for demodulating signals from the 
pickup 12 into a bitstream, and a buffer 1 for transiently 
storing the bitstream from the demodulating circuit 13. 
[0132] The pickup 12 illuminates the laser light on a 
recording track on the signal recording surface of the 
optical disc 1 run in rotation to read out moving picture 
data recorded on the optical disc 1 01 . The demodulating 
circuit 13 demodulates moving picture data supplied 
from the pickup 12 into a bitstream conforming to the 
MPEG2 standard. This input bitstream is transiently 
stored in the buffer 1 . 

[0133] The moving picture encoding device includes 
a switch SW1 for switching a bitstream S21 from the 
buffer 1 to one of the fixed terminals A or B, a decoder 
unit 2 for decoding the bitstream S21 from the fixed ter- 
minal A into picture signals and an encoder 4 for encod- 
ing picture signals S27 from the decoder unit 2. 
[0134] The switch SW1 is responsive to control sig- 
nals from the control circuit 11 to switch the bitstream 
S21 from the buffer 1 to one of the fixed terminals A or 
B. The decoder unit 2 decodes the bitstream S22 from 
the switch SW1 into picture signals S27 which are then 
encoded by the encoder 4 into a bitstream. 
[01 35] The decoder unit 2 includes a switch 9 for set- 
ting the bitstream S22 from the fixed terminal A of the 
switch SW1 to one of the fixed terminals A or B, a buffer 
5 for transiently storing the bitstream S23 from the fixed 
terminal A of the switch 9 and a decoder 6 for decoding 
the bitstream from the buffer 5. 

[0136] The decoder unit 2 includes a buffer 7 for tran- 
siently storing a bitstream S24 from the fixed terminal B 
ofthe switch 9, a decoder 8 for decoding the bitstream 
from the buffer 7, and a switch 10 for selecting one of 
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the fixed terminal A fed with a decoded picture output 
S25 from the decoder 6 or the fixed terminal B fed with 
a decoded picture output S26 from the decoder 8. 
[01 37] The buffers 5 and 7 are memories for transient- 
ly storing an input stream to the decoder unit 2. These 
buffers 5 and 7 are used for decoding the bitstream of 
the MPEG2 standard in the downstream side decoders 
6, 8. The capacity of these buffers 5 and 7 are prescribed 
by the standards of MPEG2 MP @ ML (main profile/main 
level) and is, for example, of the order of 1 .75 Mbits. 
[0138] The bitstreams sent to these buffers 5 and 7 
are switched by the switch 9 so as to be sent to one of 
the buffers 5 or 7. 

[01 39] The decoders 6, 8 decode the bitstream com- 
pressed in accordance with the MPEG system to gen- 
erate digital picture data. These decoders 6 and 8 de- 
code the pictures in accordance with the decoding time 
control information (DTS) attached to the respective pic- 
tures of the encoded data. 

[0140] The decoder unit 2 is under control by the con- 
trol circuit 11 which manages the bit storage quantity of 
the buffer 7 to control the bitrate of the bitstream to be 
read. During skip reproduction, the control circuit 11 
changes over the state of the switch SW1 at a timing of 
interruption between a stream containing an out-point 
picture and another stream containing an in-point pic- 
ture. 

[0141] The decoder unit 2 includes two decoders 6 
and 8, for simultaneously encoding the bitstreams S23 
and S24. These decoders 6 and 8 decode the bitstream 
on the GOP basis for interconnecting the in-point and 
the out-point in the bitstream. 

[01 42] The switch 1 0 is timed to the control signals of 
the control circuit 11 to switch between signals of the 
decoders 6 and 8 to output the selected signal to the 
encoder 4. 

[0143] The moving picture encoding device also in- 
cludes a delay circuit 3 for delaying the bitstream S29 
from the fixed terminal B of the switch SW1 , an encoder 
4 for encoding the picture signals S27 outputted by the 
switch 10 of the decoder unit 2 to a bitstream S28 and 
a switch SW2 for switching between a fixed terminal A 
fed with the bitstream S28 from the encoder 4 and a 
fixed terminal B fed with the bitstream S30 from the de- 
lay circuit 3 to select one of these fixed terminals A or B. 
[0144] The delay circuit 3 sends the bitstream S29 
from the fixed terminal B of the switch SW1 with a pre- 
set delay to the fixed terminal B of the switch SW2. The 
delay time in the present embodiment is 4-frame time, 
as will be explained subsequently. 
[0145] The decoder unit 2 and the encoder 4 consti- 
tute re-encoding means for decoding and subsequently 
encoding an input bitstream. The encoder 4 re-encodes 
only pictures decoded by the decoder unit 2 and which 
are required in connection with the in-point and the out- 
point. 

[0146] The moving picture encoding device includes 
an interfacing circuit 14 for converting a bitstream S41 
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from a switch SW2 and a control circuit 11 for controlling 
the interfacing circuit 14, a switch SW1 , a decoder unit 
2, a delay circuit 3, an encoder 4 and a switch SW1 . 
[0147] An interfacing circuit 214 converts the bit- 
stream from the switch SW2 into data of the digital bus s 
form of the IEEE 1 394 standard to output the converted 
data to outside. 

[0148] The signals of respective portions of the mov- 
ing picture encoding device are explained by simultane- 
ously referring to Fig. 7. 

[01 49] To the buffer 5 of the decoder unit 2 is entered 
an array of pictures I02, BOO, B01 , P05, B03, B04, B06, 
B07, as a bitstream S23. This bitstream S23 is decoded 
by the decoder 6 into picture signals S25. These picture 
signals contain frames F00, F01, F02, F03 and F04. 
[0150] The picture coding types, allocated to these 
frames, are B, B, I, B, R in agreement with the types of 
the original pictures. The delay of picture signals S25 
from the bitstream S23 is 1 frame, with startup delay be- 
ing 0. 

[0151] The bitstream S28 (S25), obtained on encod- 
ing the picture signals S25 entered from the decoder 6 
and the picture coding type, contains an array ofpictures 
I02, B00, B01, P04 and P05. This bitstream S28 is de- 
layed by four frames. 

[0152] The buffer 7 is fed with a GOP-n, which is an 
in-point side GOP constituted by pictures In2, BnO, Bn1 , 
Pn5, Bn3, Bn4, Pn8, Bn6, Bn. This bitstream S24 is de- 
coded by the decoder 8 and turned into picture signals. 
These picture signals contain FnO, Fn1 , Fn2, Fn3, Fn4, 
Fn5, Fn6, Fn7 and Fn8. 

[0153] The picture coding types, allocated to the 
frames, Fn5 to Fn8, among the above pictures, are I, B, 
B, P, in agreement with the types of the original pictures. 
The delay of picture signals S24 from the bitstream S26 
is 1 frame, with startup delay being 0. 
[01 54] The bitstream S28 (S26 input), obtained on en- 
coding the picture signals S26 entered from the decoder 
8 and the picture coding type, contains an array of pic- 
tures In5, Pn8, Bn6 and Bn8. This bitstream S28 is de- 
layed by four frames. 

[01 55] The delay circuit 3, fed with a GOP GOP-(n+1 ), 
is delayed by four frames and is outputted as a bitstream 
S30. 

[01 56] The bitstream S28 from the encoder 4 and the 
bitstream S30 from the delay circuit 3 are switched by 
the switch SW2 under control by the control circuit 11, 
so that the GOP GOP(n+1), next following I02, BOO, 
B01, P04, B03, In5, Pn8, Bn6 and Bn8, constituted by 
the GOP GOP-new-0 obtained on re-encoding the GOP 
GOP-0 and the GOP-new-n obtained on re-encoding 
the GOP GOP-n, is now the output bitstream S31 . 
[0157] Meanwhile, the present invention is not limited 
ti the above-described embodiment. For example, the 
recording medium according moving picture data to the 
moving picture encoding device is not limited to an op- 
tical disc, with the output signal form not being limited 
to IEEE1394. 


[01 58] A second embodiment ofthe present invention 
is hereinafter explained. In the present second embod- 
iment, the present invention is directed to a moving pic- 
ture recording/reproducing apparatus 20, shown for ex- 
ample in Fig.8. 

[01 59] When editing a bitstream, already recorded on 
a recording medium 40, the moving picture recording/ 
reproducing apparatus 20 re-encodes video data to 
record the re-encoded video data on a recording medi- 
um 40 in order to enable the editing point (the point from 
the tout-point picture to the in-point picture) to be repro- 
duced seamlessly. 

[01 60] The out-point picture (out-point) means the last 
picture of one of two stories being edited to a sole 
stream. The in-point picture (in-point) means a first pic- 
ture of the other of the two stories. That is, the moving 
picture recording/reproducing apparatus 20 re-encodes 
video data to enable seamless reproduction from the 
out-point to the in-point. 

[0161] Specifically, the moving picture recording/re- 
producing apparatus 20 includes a read-out unit 21 , for 
reading out data from the recording medium 40, an ed- 
iting information input unit 22, to which the information 
of a picture to be edited is entered, a demodulation cir- 
cuit 23, an error correction circuit 24 for error correction, 
a buffer memory 25 for transient storage of a bitstream, 
a demultiplexer 26 for separating a bitstream to a video 
stream and an audio bitstream, and an analysis unit 27. 
[01 62] When the user desires to edit a video program 
recorded on the recording medium 40, the editing infor- 
mation input unit 22 sends the editing information on the 
out-point and the in-point to the read-out unit 21 and to 
the analysis unit 27. 

[0163] The read-out unit 21 sends data read out from 
the recording medium 40 via the demodulation circuit 
23 and the error correction circuit 24 to the buffer mem- 
ory 25. The demultiplexer 26 read out a bitstream stored 
in the buffer memory 25 to send it first to the analysis 
unit 27 to split the bitstream into a video stream and an 
audio stream in order to send the video stream to a video 
decoder 29 and to a terminal b of a switching circuit 31 
and in order to send the audio stream to a multiplexer 
32 as later explained. 

[0164] The analysis circuit 27 analyzes a bitstream 
from the demultiplexer 26 and vbv_delay, which is a pa- 
rameter defined by a picture header of the MPEG video 
and which indicates the initial state ofthe buffer at the 
time of random accessing, to select the method for re- 
encoding a video stream (change of the picture coding 
type or allocation of the encoding bit quantity at the time 
ofre-encoding) and the method for re-multiplexing to 
control the video encoder 30 and the multiplexer 32 in 
accordance with the selected contents. 
[0165] The moving picture recording/reproducing ap- 
paratus 20 also includes a video decoder 29 for decod- 
ing a video stream, a video encoder 30 for encoding vid- 
eo data, a switching circuit 31 for switching between 
source video streams, a multiplexer 32 for multiplexing 
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the stream and an error correction circuit 33 for append- 
ing an error correction code. The moving picture record- 
ing/reproducing apparatus 20 further includes a modu- 
lation circuit 34 for modulating a bitstream and a writing 
unit 35 for writing a bitstream on the recording medium 
40. 

[0166] The video decoder 29 decodes the video 
stream to send the video data to the video encoder 30, 
which then encodes the video data with a bitrate under 
contro! by the analysis unit 27 to send the video stream 
to a terminal a ofthe switching circuit 31 . The video de- 
coder 29 and the video encoder 30 are used for re-con- 
structing GOPs containing an in-point and an out-point 
and GOPs lying ahead and at back of the firstly-stated 
GOPs. 

[0167] The switching circuit 31 is constructed so as to 
be set to its terminals a or b in case of re-encoding or 
otherwise, respectively. The switching circuit 31 outputs 
one of the video streams sent to the terminals a or b to 
send the selected video stream to the multiplexer 32. 
[0168] The multiplexer 32 multiplexes the video 
stream from the switching circuit 31 and the audio 
stream from the demultiplexer 26 to generate a bit- 
stream which is sent via error correction circuit 33 and 
the modulation circuit 34 to the writing unit 35. 
[0169] The writing unit 35 records the bitstream from 
the modulation circuit 34 on the recording medium 40. 
[0170] When re-encoding the video on the out-point 
side and the in-point side to effect continuous reproduc- 
tion from the out-point side video to the in-point side vid- 
eo, caution must be exercised not to cause failure of the 
VBV buffer which is a buffer of an imaginary decoder 
defined on the MPEG. It is noted that failure of the VBV 
buffer means overflowing or underflowing of the buffer. 
[0171] In the above-described moving picture record- 
ing/reproducing apparatus 20, the analysis unit 27 con- 
trols the video encoder 30 and the multiplexer 32 in ac- 
cordance with the flowchart shown in Fig.9 to effect re- 
encoding and multiplexing. 

[0172] The analysis unit 27 decides the initial bit stor- 
age quantity Bvsd of the VBV buffer when decoding the 
first picture of the in-point side video to be re-encoded 
(step S11). As the initial bit storage quantity Bvsd, any 
suitable value may be set depending on the application 
used. For example, the initial bit storage quantity Bvsd 
may be the maximum value of the VBV buffer, which is 
1.75 Mbits for MPEG2MP@ML The analysis unit 27 
controls the video encoder 30 and the multiplexer 32 to 
re-encode and re-multiplex the out-point side video 
(step S1 2) and subsequently to re-encode and multiplex 
the in-point side video (step S13). 
[0173] At the above step S12, the analysis unit 27 
controls the re-encoding and multiplexing of the out- 
point in accordance with the flowchart shown in Fig. 10. 
[0174] At step S21, the analysis unit 27 sets the pic- 
ture type of the respective pictures of the video to be re- 
encoded, before proceeding to step S22. 
[0175] It is assumed that the video stream before re- 


encoding is constructed as shown for example in Fig. 
11 A, and is recorded in the display sequence of GOP- 

0, GOP-1 , - on the recording medium 40. The symbols 

1, P and B denote I-, P- and B-pictures, while the num- 
s bers next following the suffixes I, P and B denote the 

picture display sequence in the GOP. In the GOP GOP- 
0, for example, the bitstream is constructed in the se- 
quence of 112, B10, B11, - \ however, the pictures dis- 
played following the decoding are arrayed in the se- 
io quence of B10, B11, B12, ••• The re-encoding when the 
user designates B11 of the GOP GOP-1 as an out-point 
picture Pout is now explained. 

[01 76] If the processing of step S1 is done for the first 
time. The picture B10 is set as an I -picture, a picture B11 

*5 is set as a P-picture and other pictures are set as shown 
in Fig.11B, so that only the GOP GOP-1 will be re-en- 
coded. If the processing of step S21 is done following 
the step S26, the picture types of the respective pictures 
of the respective GOPs are determined so that the 

20 GOPs GOP-0 and GOP-1 will be re-encoded. 

[0177] At step S22, the bit storage quantity Bos of the 
VBV buffer when decoding the first picture of the video 
to be re-encoded is determined, before processing 
transfers to step S23. This quantity is calculated from 

2S the value of vbv_delay of the first encoded picture of an 
original GOP GOP-1. 

[0178] At step S23, the analysis unit 27 sets the allo- 
cated bit quantity ofthe respective pictures of the video 
to be encoded before proceeding to step S24. 

30 [01 79] At step S24, the analysis unit 27 assumes that 
the encoding is done with the above-described allocated 
bit quantity and calculates the bit storage quantity Bendl 
of the virtual decoder after the end of decoding in the 
last picture of the video for encoding. Then, processing 

35 transfers to step S25. 

[01 80] At step S25, the analysis unit 27 judges wheth- 
er or not Bendl is not less than the initial bit storage 
quantity Bvsd. If it is found that Bendl is not less than 
the initial bit storage quantity Bvsd, processing transfers 

40 to step S27 and, if otherwise, to step S26. 

[0181] At step S26, the analysis unit 27 changes the 
encoded picture, at which re-encoding should be start- 
ed, to a GOP picture ahead of the out-point picture, to 
then revert to step S21 . The analysis unit 27 at step S21 

45 decides the picture type to then perform the processing 
downstream of the step S22, as described above. 
[0182] At step S27, the analysis unit 27 controls the 
video encoder 30 and the multiplexer 32 to re-encode 
and multiplex the video to terminate the processing at 

50 step S1 2 as described above. The control contents ofthe 
analysis unit 27 differs depending on whether or not the 
processing has gone through the step S26. 
[0183] Specifically, if the processing has transferred 
to step S27 without passing through step s26, the anal- 

55 ysis unit 27 re-encodes only the GOP containing an out- 
point, that is GOP-1 , and controls the video encoder 30 
to generate the GOP GOP-1 -x, as shown in Fig.11B. 
That is, the video encoder 30 re-encodes B10 of the 
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GOP GOP-1 to 11 Ox of an (-picture, while re-encoding 
the out-point picture B11 to P11x of the P-picture to gen- 
erate a new GOP GOP-1 -x. That is, the video encoder 
30 re-encodes the GOP GOP-1 , containing the picture 
of the out-point B11, to a GOP GOP-1 -x, made up of 
pictures 11 Ox and P11x, so that the picture lying at back 
of the out-point picture, for example, 112 or B1 3 in the 
GOP GOP-1, is not used for reference for prediction in 
decoding. Meanwhile, the SQE sequence_end_code 
ofthe GOP GOP-1 -x denotes the end of the GOP. 
[0184] The bit storage quantity ofthe buffer of the vir- 
tual decoder is changed as shown in Fig. 12, in which 
the ordinate stands for the bit storage quantity in the 
buffer, Bmax is the maximum bit quantity in the buffer 
and the abscissa stands for lapse of time. The time t(*) 
denotes the decoding time of an encoded picture. For 
example, t(P08) denotes the decoding time of P08. The 
rightwardly rising straight line denotes the input bitrate 
to the buffer. For example, since t(P08) until time t(B06), 
the bitstream is entered to the buffer so that the bit stor- 
age quantity in the buffer is increased. At the decoding 
time of each encoded picture, the bit quantity of the en- 
coded picture in question is instantly removed from the 
buffer to decrease the bit storage quantity in the buffer. 
The decreased bit storage quantity at each decoding 
time differs with the picture type and becomes larger in 
the sequence of the I-, P- and B-pictures. 
[0185] In this case, it is seen that, if the quantity of the 
allocated bits for each of the pictures MOx and 111 x of 
the GOP GOP-1 -x is determined as shown in Fig. 12, the 
bit storage quantity Bendl is not less than the initial bit 
storage quantity Bvsdl, from the outset, such that it is 
sufficient if the GOP GOP-1 is directly re-encoded. 
[0186] If the processing has proceeded to step S27 
through step S26, the analysis unit 27 is able to encode 
the out-point by two modes as now explained. Which of 
these modes is to be selected depends on whether or 
not the maximum length of the GOP is limited by the 
application. 

[0187] As the first mode, the video encoder 30 re-en- 
codes the GOPs GOP-0 and GOP-1 to a sole GOP 
GOP-A-x, as shown in Fig.11C. In this GOP GOP-A-x, 
the pictures I02 to B07 of the GOP GOP-0 are directly 
copied into the GOP GOP-A-x. The pictures B10 and 
B11 of the GOP GOP-1 are re-encoded to P10x and 
P11x of the P-pictures. That is, the video encoder 30 re- 
encodes the respective pictures of the GOP GOP-1 up 
to the out-point into inter-picture predictive-coded pic- 
tures, that can be predicted from the pictures of the GOP 
GOP-0 and part of the pictures of the GOP GOP-1 , while 
generating a new GOP GOP-A-x that can be decoded 
without predictive reference to the pictures lying in back 
of the out-point picture, such as 113 or P15. 
[0188] tf assumed that the GOP GOP-0 is not re-en- 
coded, the bit storage quantity of the buffer of the virtual 
decoder is changed as shown in Fig.1 3 such that Bendl 
is smaller than the initial bit storage quantity Bvsd. That 
is, if the quantities of allocated bits to the pictures 11 Ox, 


P11x of the GOP GOP-1 -x are decoded at step S23, 
Bendl < Bvsd. The video encoder 30 thus changes the 
encoded picture at which to start the ere-encoding to a 
picture of a GOP directly ahead of the GOP containing 

5 the out-point picture. By re-encoding the original picture 
B11 to a P-picture instead of to the I -picture, the bit stor- 
age quantity in the buffer can be reduced only to a lesser 
extent, asa result ofwhich Bendl can be rendered larger 
than the initial bit storage quantity Bvsd, as shown in 

10 Fig. 14. 

[0189] As a second embodiment, the video encoder 
30 re-encodes two GOPs, that is GOP-0 and GOP-1 , to 
GOPs GOP-A-xl and to GOP-A-x2, as shown in Fig. 
1 1 D. In the GOP GOP-0, the pictures I02 to B04 are di- 
15 rectly copied into the GOP GOP-A-x1. P08, Bo6 and 
B07 are re-encoded to I08x, B06x, B07x in the GOP 
GOP-A-x2. In the GOP GOP-1, B10 and b11 are re-en- 
coded to P10x, P11x in the GOP GOP-A-x2. That is, the 
video encoder 30 is able to re-encode the pictures of the 
20 GOP containing the out-point picture to inter-picture pre- 
dictive ly coded pictures predicted from the picture of the 
GOP GOP-0 to generate new GOPs, that is GOP-A-xl 
and GOP-A-x2, so that decoding will be possible without 
reference for prediction to the pictures lying in back of 
25 the out-point picture. Meanwhile, the GOP GOP-A-x1 
and GOP-A-X2 are two GOPs produced from the above- 
mentioned GOP-A-x. 

[0190] The second mode is used when limitations are 
imposed on the maximum length of the GOP It is as- 
30 sumed here that the maximum GOP length is limited to 
five pictures. That is, the first mode or the second mode 
may be used if the maximum length of the GOP is limited 
or otherwise, respectively. 

[0191] The analysis unit 27 performs control so that 
35 the bit occupation quantity Bendl will not be lower than 
the initial bit storage quantity Bvsd to prevent buffer fail- 
ure and consequent overflowing or underflowing of the 
buffer. 

[0192] It is then assumed that the in-point is to be re- 
40 encoded. 

[0193] As a specified processing at step S13 shown 
in Fig. 9, the in-point re-encoding processing is control- 
led in accordance with the flowchart shown in Fig. 15. 
[01 94] At step S31 , the analysis unit 27 sets the video 
45 picture type to be encoded to proceed to step S32. 
[0195] It is assumed that a video stream prior to re- 
encoding is constructed as shown in Fig.16A and is re- 
corded on the recording medium 40 in the display se- 
quence of GOP-n, GOP-m, -. As for the suffixes, such 
50 as I, P or B, the right-side suffixes denote the GOP to 
which belongs the picture in question, while the left -side 
suffixes denote the sequence of pictures in the GOP in 
question displayed after decoding. For example, Bn3 is 
a B-picture belonging to the GOP GOP-n, and is dis- 
55 played in the third place in the GOP GOP-n. The re-en- 
coding in case the user specifies the picture Pn8 of the 
GOP GOP-n as the in-point picture Pin is explained. 
[0196] As for the decision of the picture type, if the 
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processing of step S31 is carried out for the first time, 
the picture types are set so that the pictures Pn8, Bn6 
and Bn7, for example, are set to an l-picture, a B-picture 
and to a B-picture, so that re-encoding wilt be performed 
only for the GOP GOP-n, as shown in Fig.16B. If the 
processing at step S31 is not the first processing, the 
picture types are set for the respective pictures of the 
GOPs, for doing the re-encoding of the GOPs GOP-n 
and GOP-m, as shown in Fig.16C. 
[0197] At step S32, the analysis unit 27 calculates the 
initial bit storage quantity B] of the VBV buffer when de- 
coding the first picture of the video not re-encoded, such 
as Im2, before processing transfers to step S33. Since 
the picture Pn8 is the in-point picture, the GOP not re- 
encoded is the GOP GOP-m. Thus, the initial bit storage 
quantity Bj at the decoding time is calculated for the first 
picture Im ofthe GOP GOP-m. The initial bit storage 
quantity Bj is calculated from the value of vbv_delay of 
the picture Im2, for example, of the GOP GOP-m. 
[01 98] At step S33, the analysis unit 27 sets the quan- 
tity of allocated bits of the respective video pictures to 
be re-encoded before proceeding to step S34. 
[0199] At step S34, the analysis unit 27 assumes that 
the encoding is to be performed with the as-set quantity 
of the allocated bits, and calculates the bit storage quan- 
tity Bend2 of the virtual decoder on decoding the last 
video picture to be re-encoded, before proceeding to 
step S35. 

[0200] At step S35, the analysis unit 27 verifies wheth- 
er or hot the bit storage quantity Bend2 at step S34 is 
larger than the bit storage quantity Bj. If the bit storage 
quantity Bend2 is larger than the bit storage quantity Bj, 
processing transfers to step S37 and, if otherwise, 
processing transfers to step S36. 
[0201] At step S36, the analysis unit 27 alters the en- 
coded picture to be re-encoded for the last time to a pic- 
ture of the GOP next following the in-point picture to then 
revert to step S31 . The analysis unit 27 at step S31 sets 
the picture type shown in Fig.16C to then perform the 
processing as from step S32. 

[0202] At step S37, the analysis unit 27 controls the 
video encoder 30 and the multiplexer 32 to re-encode 
and multiplex the video to terminate the processing at 
step S1 3 described above. The control contents of the 
analysis unit 27 at this time differ depending on whether 
or not the processing has passed through step S36. 
[0203] Specifically, if the processing has proceeded 
to step S37 without passing through step S36, the anal- 
ysis unit 27 re-encodes only the GOP-n containing the 
in-point and controls the video encoder 30 to generate 
the GOP GOP-n-x, as shown in Fig.16B. At this time, 
the video encoder 30 performs re-encoding to generate 
a new GOP GOP-n-x so that the pictures Pn8, as an in- 
point picture, Bn6 andBn7 will be In8x of an l-picture, 
Bn6x of a B-picture and Bn7x of a B-picture, respective- 
ly, to generate a new GOP GOP-n-x. That is, the GOP 
GOP-n containing the in-point picture Pn8 are re-encod- 
ed to GOP-n-x containing pictures In8x, Bn6x and Bn7x, 


so that the pictures ahead of the in-point picture, such 
as Bn3 or Bn4 in the GOP GOP-n, can be decoded with- 
out reference for prediction. Meanwhile, the 
sequence_header (SH) of the GOP GOP-n-x denotes 

5 the beginning of the GOP in question. 

[0204] At this time, the bit storage quantity of the buff- 
er of the virtual buffer is changed as shown in Fig. 17. 
[0205] If, is this case, the bit storage quantity Bend2 
is not less than the initial bit storage quantity Bj from the 

io outset, and if solely the GOP GOP-n is re-encoded, 
there is no risk of the failure of the VBV buffer. 
[0206] If conversely the processing has proceeded to 
step S39 via step S36, the analysis unit 27 controls the 
video encoder 30 so that the out-point will be re-encod- 

15 ed in two modes as now explained. Which of these two 
modes will be selected depends on whether or not lim- 
itations have been imposed on the maximum GOP 
length by the application. 

[0207] As the first mode, the video encoder 30 re-en- 

20 codes the GOPs GOP-n and GOP-m to a sole GOP 
GOP-B-x, as shown in Fig. 16C. Specifically, the video 
encoder 30 re-encodes the pictures Pn8, Bn6, Bn7 of 
the GOP GOP-n to In8x, Bn6x and Bn7x while also re- 
encoding the Im2 of the GOP GOP-m to Pm2x and re- 

25 encoding the picture at back of Im2 of the GOP GOP-m 
to the same picture type as that of the original picture. 
[0208] If it is assumed that the GOP GOP-m is not re- 
encoded, the bit storage quantity of the buffer of the vir- 
tual decoder is changed as shown in Fig. 18, such that 

30 Bend2 is smaller than the initial bit storage quantity Bj. 
That is, if the quantity of bit allocation for pictures InBx, 
Bn6x, Bn7x of the GOP GOP-n-x is set at step S32, 
Bend2 < Bj, such that re-encoding cannot be done to 
give a continuous trajectory ofthe bit storage quantities 

35 for the GOPs GOP-n-x and GOP-m. If the video encoder 
30 re-encodes the original picture Im2 to a picture Pm2x 
instead of to an l-picture, the bit storage quantity re- 
quired by the buffer can be diminished to enable re-en- 
coding to give a continuous trajectory of the bit storage 

40 quantity of the in-point side video buffer. 

[0209] In the second mode, the video encoder 30 re- 
encodes two GOPs, that is GOP-n and GOP-m, to 
GOPs GOP-B-xl and GOP-B-x2, as shown in Fig.16D. 
The video encoder 30 re-encodes Pn8, Bn6, Bn7 of the 

45 GOP GOP-n to In8x, Bn8x and Bn7x, respectively, while 
re-encoding Im2, BmO and Bm1 to Pm2x, BmOx and 
Bm1x, respectively. Also, the video encoder 30 re-en- 
codes Pm5 ofthe GOP GOP-m to Im5x of the GOP 
GOP-B-X2, while also re-encoding the picture lying at 

so back of Pm5 of the GOP GOP-m to the same picture 
type as that of the original picture. 
[0210] Meanwhile, the GOPs GOP-B-xl and GOP-B- 
x2 correspond to two GOPs of the GOP GOP-B-x. 
[0211] Which of the first and second modes is to be 

55 selected is determined as discussed in connection with 
the out-point encoding. That is, it suffices if the first 
mode or the second mode is used when the maximum 
length ofthe GOP is limited or is not limited, respectively. 
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[0212] Thus, buffer failure can be prevented from oc- 
currence by the analysis unit 27 performing control so 
that the bit storage quantity Bend2 will not be smaller 
than the initial bit storage quantity Bj. 
[021 3] It will be seen from above that if, with the mov- 
ing picture recording/reproducing apparatus 20, the out- 
point side video and the in-point side video are re-en- 
coded as described above, continuous reproduction 
from the re-encoded out-point side vide to the re-encod- 
ed in-point side video can be realized as normally with- 
out the risk of the failure of the virtual decoder buffer 
[021 4] Although the foregoing embodiment is directed 
to formulation of a program edited at the time of skip 
editing specifying the out-point and the in-point, the 
present invention is also applicable to insertion editing. 
That is, in the insertion editing, the insertion start point 
and the insertion end point in the insertion destination 
side program are specified, after which a video se- 
quence for insertion is newly encoded. The re-encoding 
method for the out-point side video according to the 
present invention can be applied at this time to the video 
re-encoding of the insertion start point of the insertion 
source side program. Also, the re-encoding method for 
the out-point side video according to the present inven- 
tion can be applied to the video re-encoding of the in- 
sertion end point of the insertion source side program. 
[0215] The in-point and out-point re-encoding 
processing, explained in connection with the first and 
second embodiments, can also be performed by install- 
ing a moving picture encoding controlling program stat- 
ing the sequence ofthe above processing on the com- 
puter from a recording medium on which has been re- 
corded the control program. 

[0216] Specifically, the computer having the above 
control program installed thereon is functionally of a 
structure as shown in Fig. 6 or 8, such that, if it is com- 
manded to skip a portion of the moving picture program 
in reproducing the moving pictures, the program por- 
tions lying ahead and at back of the skipping start point 
can be efficiently encoded to realize the seamless re- 
production of the program portions lying ahead and at 
back of the skipping start point. 


Claims 

1 . An encoding method for moving pictures for output- 
ting moving picture signals up to an out-point picture 
in a display sequence of an encoded bitstream of 
moving pictures including a group of pictures begin- 
ning with an intra-picture encoded picture followed 
by a plurality of inter-picture predictive-coded pic- 
tures as a unit domain, comprising: 

a re-constructing step for re-constructing the in- 
put video stream by re-encoding the pictures of 
the group of pictures containing said out-point 
picture beginning from the initial display picture 


of the group of pictures up to said out-point pic- 
ture into inter- picture predictive-coded pictures 
that can be predicted from pictures of another 
group of pictures displayed directly before the 
s group of pictures containing said out-point pic- 

ture, for re-construction into a group of pictures 
that can be decoded without having predictive 
reference to display pictures lying at back of 
said out-point picture. 

10 

2. The moving picture encoding method according to 
claim 1 wherein said re-constructing step re-en- 
codes the first intra-picture encoded picture in said 
group of pictures containing said out-point picture 
is to a forwardly predictive- encoded picture that can 
be predicted from a picture of another group of pic- 
tures displayed directly before the group of pictures 
containing said out-point picture. 

20 3. The moving picture encoding method according to 
claim 1 wherein said re-constructing step calculates 
an initial bit storage quantity required for a virtual 
buffer at the time of decoding the first encoded pic- 
ture of the encoded moving picture signals dis- 

2S played nest to said out-point picture; 

said re-constructing step decodes the last pic- 
ture for encoding, on the assumption that en- 
coding is done with the quantity of allocated bits 

30 used in case of re-encoding the pictures of the 

group of pictures containing said out -point pic- 
ture from its first display picture to said out-point 
picture to a sole group ofpictures, to calculate 
the quantity of stored bits at the time oftermina- 

35 tion of decoding ofthe virtual decoder; and 

wherein 

said re-constructing step re-encodes the pic- 
tures of said group of pictures containing the 
out-point picture from the first display picture to 

40 said out-point picture into a sole group of pic- 

tures if said quantity of stored bits at the time 
of termination of the decoding is not less than 
the initial bit storage quantity, said re-construct- 
ing step doing re-encoding to an inter-picture 

45 predicted encoded picture that is predicted 

from the picture of a group of pictures displayed 
directly before the group of pictures containing 
said out-point picture. 

so 4. An encoding apparatus for moving pictures for out- 
putting moving picture signals up to an out-point pic- 
ture in a display sequence of an encoded bitstream 
of moving pictures including a group of pictures be- 
ginning with an intra-picture encoded picture fol- 

55 lowed by a plurality of inter-picture predictive-coded 
pictures, as a unit domain, comprising: 

re-constructing means for re-constructing the 
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input video stream by re-encoding the pictures 
of the group of pictures containing said out- 
point picture from the initial display picture up 
to said out-point picture into inter-picture pre- 
dictive-coded pictures that can be predicted 
from pictures of another group of pictures dis- 
played directly before the group of pictures con- 
taining said out-point picture, for re-construc- 
tion into a group of pictures that can be decoded 
without having predictive reference to display 
pictures lying backwardly of said out-point pic- 
ture. 

5. The moving picture encoding apparatus according 
to claim 4 wherein said re-constructing means re- 
encodes the first intra-picture encoded picture in 
said group of pictures containing said out-point pic- 
ture to a forwardly predictive- encoded picture that 
can be predicted from a picture of another group of 
pictures displayed directly before the group of pic- 
tures containing said out-point picture. 

6. The moving picture encoding apparatus according 
to claim 4 wherein said re-constructing means cal- 
culates an initial bit storage quantity required tor a 
virtual decoder buffer at the time of decoding the 
first encoded picture ofthe encoded moving picture 
signals displayed next to said out-point picture; 
wherein 

said re-constructing means decodes the last 
picture for encoding, on the assumption that en- 
coding is done with the quantity of allocated bits 
used in case ofre-encoding the pictures of the 
group of pictures containing said out-point pic- 
ture from its first display picture to said out-point 
picture to a sole group ofpictures, to calculate 
the quantity of stored bits at the time of termi- 
nation of decoding of the virtual decoder; and 
wherein 

said re-constructing means re-encodes the pic- 
tures of said group of pictures containing the 
out-point picture from the first display picture to 
said out-point picture into a sole group of pic- 
tures if said quantity of stored bits at the time 
of termination of the decoding is not less than 
the initial bit storage quantity, said re-construct- 
ing means doing re-encoding to an inter-picture 
predictive-coded picture that is predicted from 
the picture of a group of pictures displayed di- 
rectly before the group of pictures containing 
said out-point picture. 

7. A recording medium having a control program re- 
corded thereon, said control program outputting 
moving picture signals up to an out-point picture in 
a display sequence of an encoded bitstream of 
moving pictures including a group of pictures begin- 


10 


is 


20 8. 


25 


35 


40 


50 


55 


ning with an intra-picture encoded picture followed 
by a plurality of inter-picture predictive-coded pic- 
tures, as a unit domain, wherein the improvement 
resides in that 

said control program re-constructs the input 
video stream by re-encoding the pictures of the 
group of pictures containing said out-point pic- 
ture from the initial display picture of the group 
of pictures up to said out -point picture into inter- 
picture predictive -coded pictures that can be 
predicted from pictures of another group of pic- 
tures displayed directly before the group of pic- 
tures containing said out-point picture, for re- 
construction into a group ofpictures that can be 
decoded without having predictive reference to 
display pictures lying backwardly of said out- 
point picture. 

The recording medium according to claim 7 wherein 
the control program recorded thereon re-encodes 
the first intra-picture encoded picture in said group 
of pictures containing said out-point picture to a for- 
wardly predictive-coded picture that can be predict- 
ed from a picture of another group of pictures dis- 
played directly before the group of pictures contain- 
ing said out-point picture. 

The recording medium according to claim 7 wherein 
the control program recorded thereon calculates an 
initial bit storage quantity required for a virtual buffer 
at the time of decoding the first encoded picture of 
the encoded moving picture signals displayed next 
to said out-point picture; wherein 

said control program decodes the last picture 
for encoding, on the assumption that encoding 
is done with the quantity of allocated bits used 
in case ofre-encoding the pictures of the group 
of pictures containing said out-point picture 
from its first display picture to said out-point pic- 
ture to a sole group of pictures, to calculate the 
quantity of stored bits at the time of termination 
of decoding of the virtual decoder; and wherein 
said control program re-encodes the pictures of 
said group of pictures containing the out-point 
picture from the first display picture to said out- 
point picture into a sole group of pictures if said 
quantity of stored bits at the time of termination 
of the decoding is not less than the initial bit 
storage quantity, said re-constructing means 
doing re-encoding to an inter-picture predic- 
tive-coded picture that is predicted from the pic- 
ture of a group of pictures displayed directly be- 
fore the group of pictures containing said out- 
point picture if said quantity of stored bits at the 
time of termination of the decoding is not less 
than the initial bit storage quantity. 
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1 0. An encoding method for moving pictures for output- 
ting moving picture signals in a display sequence of 
an encoded bitstream of including a group of mov- 
ing pictures beginning with an intra-picture encoded 
picture followed by a plurality of inter-picture predic- 
tive-coded pictures, as a unit domain, comprising: 

a re-constructing step of re -constructing the in- 
put video stream by re-encoding the first intra- 
coded picture of a group of pictures displayed 
directly backwardly of a group of pictures con- 
taining said in-point picture to an inter-picture 
predictive-coded picture that is predicted from 
a picture of said group of pictures containing 
said in-point picture, for re-construction into a 
group of pictures that can be decoded without 
having predictive reference to display pictures 
lying ahead of said in-point picture. 

11. The moving picture encoding method according to 
claim 10 wherein said re-constructing step re-en- 
codes the first intra-picture encoded picture of a 
group of pictures displayed directly backwardly 
ofthe group ofpictures containing said in-point pic- 
ture to a forwardly predicted encoded picture pre- 
dicted from a picture of the group of pictures con- 
taining said in-point picture. 

12. The moving picture encoding method according to 
claim 10 wherein said re-constructing step re-en- 
codes a first forwardly predictive-coded picture ly- 
ing backwardly of the in-point picture in the display 
sequence to an intra-picture encoded picture. 

13. The moving picture encoding method according to 
claim 10 wherein said re-constructing step calcu- 
lates an initial bit storage quantity required for a de- 
coder buffer at the time of decoding a first encoded 
picture of a group of pictures next following said 
group of pictures containing said in-point picture in 
a display sequence; 

said re-constructing step decodes the last pic- 
ture for encoding, on the assumption that en- 
coding is done with the quantity of allocated bits 
used in case of re-encoding the pictures ofthe 
group of pictures containing said in-point pic- 
ture from the in-point picture to the last dis- 
played picture, to a sole group of pictures, to 
calculate the quantity of stored bits at the time 
of termination of decoding ofthe virtual decod- 
er; and wherein . 

said re-constructing step re-encodes the pic- 
tures of said group of pictures containing the in- 
point picture from the in-point picture to the last 
display picture into a sole group of pictures if 
said quantity of stored bits at the time of termi- 
nation of the decoding is not less than the initial 


bit storage quantity, said re-constructing step 
re-encoding the first intra-picture coded picture 
ofthe group ofpictures displayed directly back- 
wardly of said group of pictures containing the 
s in-point picture to an inter-picture predictive- 

coded picture predicted from a picture of the 
group of pictures containing the in-point pic- 
ture. 

io 14. An encoding apparatus for moving pictures for out- 
putting moving picture signals in a display se- 
quence of an encoded bitstream of including a 
group of moving pictures beginning with an intra- 
picture encoded picture followed by a plurality ofin- 

75 ter-picture predictive-coded pictures, as a unit do- 
main, comprising: 

re-constructing means for re-constructing the 
input video stream by re-encoding the first in- 

20 tra-coded picture of a group of pictures dis- 

played directly backwardly of a group of pic- 
tures containing said in-point picture to an inter- 
picture predictive -coded picture that is predict- 
ed from a picture of said group of pictures con- 

25 taining said in-point picture, for re-construction 

into a group of pictures that can be decoded 
without having predictive reference to display 
pictures lying ahead of said in-point picture. 

30 15. The moving picture encoding apparatus according 
to claim 14 wherein said re-constructing means re- 
encodes the first intra-picture encoded picture of a 
group of pictures displayed directly backwardly 
ofthe group ofpictures containing said in-point pic- 

35 ture to a forwardly predictive-coded picture predict- 
ed from a picture of the group of pictures containing 
said in-point picture. 

16. The moving picture encoding apparatus according 
40 to claim 14 wherein said re-constructing means re- 
encodes a first forwardly predictive-coded picture 
lying backwardly of the in-point picture in the display 
sequence to an intra-picture encoded picture. 

45 17. The moving picture encoding apparatus according 
to claim 1 4 wherein said re-constructing means cal- 
culates an initial bit storage quantity required for a 
decoder buffer at the time of decoding a first encod- 
ed picture of a group of pictures next following said 

so group ofpictures containing said in-point picture in 
a display sequence; 

said re-constructing means decodes the last 
picture for encoding, on the assumption that en- 
55 coding is done with the quantity of allocated bits 

used in case ofre-encoding the pictures ofthe 
group ofpictures containing said in-point pic- 
ture from the in-point picture to the last dis- 
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played picture to a sole group of pictures, to cal- 
culate the quantity of stored bits at the time of 
termination of decoding ofthe virtual decoder; 
and wherein 

said re-constructing means re-encodes the pic- 
tures of said group of pictures containing the in- 
point picture from the in-point picture to the last 
display picture into a sole group of pictures if 
said quantity of stored bits at the time of termi- 
nation of the decoding is not less than the initial 
bit storage quantity, said re-constructing means 
re-encoding the first intra -picture coded picture 
ofthe group ofpictures displayed directly back- 
wardly of said group of pictures containing the 
in-point picture to an inter-picture predictive- 
coded picture predicted from a picture of the 
group of pictures containing said in-point pic- 
ture if said quantity of stored bits at the time of 
termination of the decoding is less than the in- 
itial bit storage quantity. 

18. A recording medium having a control program re- 
corded thereon, said control program being formu- 
lated for outputting moving picture signals up to an 
in-point picture in a display sequence of an encoded 
bitstream of moving pictures including a group of 
pictures beginning with an intra-picture encoded 
picture followed by a plurality of inter-picture predic- 
tive-coded pictures, as a unit domain, wherein the 
improvement resides in that 

said control program re-constructs the input 
video stream by re-encoding the first intra-pic- 
ture coded picture of a group of pictures dis- 
played directly backward ly ofthe group of pic- 
tures containing said in-point picture to an inter- 
picture predictive-coded picture predicted from 
a picture ofthe group ofpictures containing said 
in-point picture, for re-construction into a group 
ofpictures that can be decoded without having 
predictive reference to display pictures lying 
ahead of said in-point picture. 

1 9. The recording medium according to claim 1 8 where- 
in said control program re-encodes the first intra- 
picture encoded picture ofa group of pictures dis- 
played directly backwardly of the group of pictures 
containing said in-point picture to a forwardly pre- 
dictive-coded picture predicted from a picture of the 
group of pictures containing said in-point picture. 

20. The recording medium according to claim 1 8 where- 
in said control program re-encodes a first forwardly 
predictive -coded picture lying backwardly of the in- 
point picture in the display sequence to an intra-pic- 
ture encoded picture. 

21 . The recording medium according to claim 1 8 where- 
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in said control program calculates an initial bit stor- 
age quantity required for a decoder buffer at the 
time of decoding a first encoded picture of a group 
of pictures next following said group of pictures con- 
taining said in-point picture in a display sequence; 

said control program also decodes the last pic- 
ture for encoding, on the assumption that en- 
coding is done with the quantity of allocated bits 
used in case of re-encoding the pictures ofthe 
group of pictures containing said in-point pic- 
ture from the in-point picture to the last dis- 
played picture to a sole group of pictures, to cal- 
culate the quantity of stored bits at the time of- 
termination of decoding ofthe virtual decoder; 
said control program re-encoding the pictures 
of said group of pictures containing the in-point 
picture from the in-point picture to the last dis- 
play picture into a sole group of pictures if said 
quantity of stored bits at the time of termination 
of the decoding is not less than the initial bit 
storage quantity, 

said control program re-encoding the first intra- 
picture coded picture of the group of pictures 
displayed directly backwardly of said group of 
pictures containing the in-point picture to an in- 
ter-picture predictive-coded picture predicted 
from a picture of the group of pictures contain- 
ing said in-point picture if said quantity of stored 
bits at the time of termination of the decoding 
is less than the initial bit storage quantity. 

22. An encoding method for moving pictures for output- 
ting signals for an input bitstream comprised of en- 
coded picture signals made up of an intra-picture 
coded picture and a plurality of predictive-coded 
pictures predicted based on said intra-picture cod- 
ed picture, as component elements, with a plurality 
of said encoded pictures constituting a group of pic- 
tures as a unit domain, said signals being said input 
bitstream skipping from a first point to a second 
point in a display sequence; comprising: 

a re-constructing step of re-constructing, in an 
input bitstream, a group of pictures of a unit do- 
main containing said first point up to said first 
point in a display sequence, and a group of pic- 
tures of a unit domain directly previous to said 
group of pictures containing said first point in 
the display sequence, into a first group of pic- 
tures that can be decoded without predictive 
reference to a picture lying backwardly of said 
first point, and of re-constructing pictures be- 
ginning from said second point in the display 
sequence of a group of pictu res of a unit domain 
containing said second point, and another 
group of pictures of the unit domain directly fol- 
lowing said group of pictures containing said 


17 


33 


EP 0 935 395 A2 


34 


second point in the display sequence, into a 
second group ofpictures that can be decoded 
without predictive reference to pictures lying 
forward ly of said second point. 

23. The encoding method for moving pictures accord- 
ing to claim 22 wherein said predictive coded pic- 
tures are comprised of forwardly predictive -coded 
pictures in the picture display sequence and bidi- 
rectionally predictive-coded pictures in the display 
sequence. 

24. The encoding method for moving pictures accord- 
ing to claim 22 further comprising: 

a delay step of delaying the input bitstream at 
least for a time required for said re-constructing 
step. 

25. An encoding apparatus for moving pictures for out- 
putting signals for an input bitstream comprised of 
encoded picture signals made up of an intra-picture 
coded picture and a plurality of predictive-coded 
pictures predicted based on said intra-picture cod- 
ed picture, as component elements, with a plurality 
of said encoded pictures constituting a group of pic- 
tures as a unit domain, said signals being said input 
bitstream skipping from a first point to a second 
point in a display sequence thereof; comprising: 

re-constructing means for re-constructing, in 
an input bitstream, a group of pictures of a unit 
domain containing said first point up to said first 
point in a display sequence, and a group of pic- 
tures of a unit domain directly previous to said 
group of pictures containing said first point in 
the display sequence, into a first group of pic- 
tures that can be decoded without predictive 
reference to a picture lying backwardly of said 
first point, and of re-constructing pictures begin- 
ning from said second point in the display se- 
quence of a group of pictures of a unit domain 
containing said second point, and another 
group of pictures of the unit domain directly fol- 
lowing said group of pictures containing said 
second point in the display sequence, into a 
second group of said second point. 

26. A recording medium having recorded thereon a 
control program of outputting signals for an input bit- 
stream comprised of encoded picture signals made 
up of an intra-picture coded picture and a plurality 
of predictive-coded pictures predicted based on 
said intra-picture coded picture, as component ele- 
ments, with a plurality of said encoded pictures con- 
stituting a group of pictures as a unit domain, said 
signals being said input bitstream skipping from a 
first point to a second point in a display sequence 
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thereof; wherein the improvement resides in that 

said control program re-constructs, in an input 
bitstream, a group ofpictures of a unit domain 
containing said first point up to said first point 
in a display sequence, and a group of pictures 
of a unit domain directly previous to said group 
of pictures containing said first point in the dis- 
play sequence, into a first group of pictures that 
can be decoded without predictive reference to 
a picture lying backwardly of said first point, 
said control program also re-constructing pic- 
tures beginning from said second point in the 
display sequence of a group of pictures of a unit 
domain containing said second point, and an- 
other group of pictures of the unit domain di- 
rectly following said group of pictures contain- 
ing said second point in the display sequence, 
into a second group of said second point. 


27. An encoding method for moving pictures for output- 
ting signals for an input bitstream, said input bit- 
stream being comprised of encoded picture signals 
made up of an intra-picture coded picture, forwardly 

2S predictive-coded pictures, obtained on forward pre- 
dictive coding in the display sequence, and a plu- 
rality of bidirectionally predictive -coded pictures, 
obtained on bidirectional predictive coding in the 
display sequence, with a plurality of said encoded 

30 pictures constituting a group of pictures as a unit 
domain, said signals being said input bitstream 
skipping from a first point to a second point in a dis- 
play sequence thereof, comprising: 
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a re-constructing step of decoding a group of 
pictures of the unit domain containing said first 
point if said first point is the bidirectionally pre- 
dictive-coded picture to re-encode pictures up 
to said first point in the display sequence, and 
of decoding a group of pictures of the unit do- 
main containing said second point if said sec- 
ond point is a forwardly predictive-coded pic- 
ture or a bidirectionally predictive-coded pic- 
ture, to re-encode pictures lying backwardly of 
said second point in the display sequence. 

28. The encoding method for moving pictures accord- 
ing to claim 27 further comprising: 

a delay step of delaying the input bitstream at 
least for a time required for said reconstructing 
step. 


29. An encoding apparatus for moving pictures for out- 
55 putting signals for an input bitstream, said input bit- 
stream being comprised of encoded picture signals 
made up of an intra-picture coded picture, forwardly 
predictive-coded pictures, obtained on forward pre- 
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dictive coding in the display sequence, and a plu- 
rality of bidirectionally predictive-coded pictures, 
obtained on bidirectional predictive coding in the 
display sequence, with a plurality of said encoded 
pictures constituting a group of pictures as a unit s 
domain, said signals being said input bitstream 
skipping from a first point to a second point in a dis- 
play sequence thereof, comprising: 

re-constructing means for decoding a group of 10 
pictures of the unit domain containing said first 
point if said first point is the bidirectionally pre- 
dictive-coded picture to re-encode pictures up 
to said first point in the display sequence, and 
for decoding a group of pictures of the unit do- is 
main containing said second point if said sec- 
ond point is a forwardly predictive-coded pic- 
ture or a bidirectionally predictive-coded pic- 
ture to re-encode pictures lying backwardly of 
said second point in the display sequence. 20 

30. A recording medium having recorded thereon a 
control program formulated for outputting signals 
for an input bitstream, said input bitstream being 
comprised of encoded picture signals made up of 25 
an intra-picture coded picture, forwardly predictive- 
coded pictures, obtained on forward predictive cod- 
ing in the display sequence, and a plurality of bidi- 
rectionally predictive-coded pictures, obtained on 
bidirectional predictive coding in the display se- 30 
quence, with a plurality of said encoded signals con- 
stituting a group of pictures as a unit domain, said 
signals being said input bitstream skipping from a 
first point to a second point in a display sequence 
thereof, wherein the improvement resides in that 35 

said control program decodes a group of pic- 
tures ofthe unit domain containing said first 
point if said first point is the bidirectionally pre- 
dictive-coded picture to re-encode pictures up 40 
to said first point in the display sequence, said 
control program also decoding a group of pic- 
tures of the unit domain containing said second 
point if said second point is a forwardly predic- 
tive-coded picture or a bidirectionally predic- 45 
tive-coded picture to re-encode pictures lying 
backwardly of said second point in the display 
sequence. 

so 
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